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CREATE PARENT WINDOW 
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DRAW BUTTONS ON 
PARENT WINDOW 
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FIG. 3C 



CREATE SAGITTAL CHILD 
WINDOW 
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CREATE A/P 
CHILD WINDOW 




122 



124 



126 



128 




THEN 



TO FIGURE 3D 



-TO BLOCK 166 



-TO BLOCK 200 



TO BLOCK 234 



FROM FIGURE 3F 




THEN 
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TO FIG. 3E 
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FROM FIG. 3D 6/28 




IF 
"MOVE 
ALONG DRILL AXIS" 
PR F12 KEY. 



ELSE 



FIG. 3E 



-TO BLOCK 41 2 



*• TO BLOCK 422 



TO BLOCK 452 



THEN 

IF 

TRACKBALL 
PVER THE "A/P IMAGE" 
AREA" 



.SE 



- TO BLOCK 476 



THEN 
IF" 

TRACKBALL" 
OVER THE "SAGITTAL" 
IMAGE AREA!. 



TO BLOCK 506 



THEN 

IF 

Trackball ha§" 
been clicked over 
the "robot 
control area' 



ELSE 



•TO BLOCK 536 



THEN 
TO FIG. 3F 
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TO FIG. 3C 
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ACQUIRE A/P IMAGE BUTTON 
OR F1 KEY HAS BEEN PRESSED 
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DISPLAY A/P 
IMAGE 
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180 



DISABLE & DIM 
BUTTONS:F11, F12, F5 
ENABLE & 
BRIGHTEN 
BUTTONS: F3 

* 



ASSIGN THE NULL 
END-EFFECTOR 




jTHEN 



GET CURRENT POSITION OF 
ROBOT-END-EFFECTOR FROM 
ROBOT CONTROLLER 



FIG. 4 



SET PASSTHRU MODE 
^ETUR^— 172 



ELSE 


ERROR: 
"END-EFFECTOR 
NOT ASSIGNED!" 











^RETURN}— 186 



184 



190 



196 



IF 

"SAGITTAL IMAGI 
JS DISPLAYED. 

THEN 



ELSE 


SEND MESSAGE: 
"ACQUIRE SAGITTAL IMAGE" 











SEND MESSAGE: 
SELECT THE FIDUCIALS." 



198 — |RCTIJRN^ 



^REUIRn) — 194 
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200 



ACQUIRE SAGITTAL IMAGE BUTTON 
OR F2 KEY HAS BEEN PRESSED 
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SET PASSTHRU MODE 
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t THEN 

208 — | FREEZE & CAPTURE IMAGE 
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(R^^)— 206 




212 



DISPLAY 
SAGITTAL 
IMAGE 

~T" 




DISABLE KEYS: 

F11, F12. F6 
ENABLE KEYS: 
F4 

DIM BUTTONS: 
'MOVE ROBOT, "MOVE 

ALONG AXIS", AND 
"REGISTER SAGITTAL 

IMAGE" 
BRIGHTEN BUTTONS: 
"SELECT SAGITTAL 
FIDUCIALS." 
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ASSIGN THE NULL 
END-EFFECTOR 



222 




ERROR: 
"END-EFFECTOR 
NOT ASSIGNED!" 



THEN 



GET CURRENT POSITION OF 
ROBOT-END-EFFECTOR FROM 
ROBOT CONTROLLER 
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(RCTURN) — 220 



TO FIGURE 5B 




FROM FIGURE 5A 
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IF 

A/P IMAGE 
JS DISPLAYED 

THEN 



ELSE 


SEND MESSAGE: 
"ACQUIRE A/P IMAGE" 











SEND MESSAGE: 
'SELECT THE FIDUCIALS.' 
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SELECT A/P FIDUCIALS\ 
BUTTON OR F3 KEY HAS 
BEEN PRESSED J 
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DISPLAY SQUARE] 
CURSOR J 



RESET NUMBER OF 
FIDUCIALS TO ZERO 



FIG. 6A 




ERROR" 
'ACQUIRE A/P IMAGE" 
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(RETURN) — 240 



246 



WAIT FOR* 
MOUSE 
BUTTON TO 
BE CLICKED, 



248 



250 
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PERFORM EDGE DETECTION 
AROUND THE MOUSE COORDINATE. 
EDGE DETECTION IS PERFORMED 
USING J. CANNrS [1] GRADIENT 
BASED METHOD 
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IF AT 
LEAST 3 EDGE 
PIXELS FOUND. 

THEN 



254 
_1_ 



ERROR: 
TRY AGAIN CLOSER 
TO THE FIDUCIAL" 
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MAP THE EDGE PIXELS TO 
THEIR CALIBRATED IMAGE 
COORDINATES [13]. 

~" 1 

TO FIGURE 6B 



FROM FIGURE 6B 
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FROM FIG. 6A 



1 



FIND THE CENTER OF THE 
FIDUCIAL SHADOW USING THE 
CALIBRATED EDGE PIXELS [14] 
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DRAW A CIRCLE AROUND 
THE CENTER OF THE 
FIDUCIAL SHADOW 



264 



IF 

ALL EIGHT 
IDUCALS HAVE BEEI 
LOCATED 



268 



270 



272 



274 



THEN 



SAVE THE ESTABLISHED 
IMAGE COORDINATES 
OF ALL FIDUCALS 



I 



ENABLE KEY: F5 
BRIGHTEN BUTTON: 
"REGISTER A/P IMAGE' 



I 



SEND MESSAGE: 
'REGISTER A/P IMAGE" 



GOTO: 
ENTRY1 IN FIGURE 8 
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/ SELECT SAGITTAL FIDUCIALS\ 
276 — BUTTON OR F4 KEY HAS 

V BEEN PRESSED J 
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290 
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DISPLAY SQUARE 
CURSOR J 



RESET NUMBER OH 
FIDUCIALS TO ZERO 
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ERROR* 
'ACQUIRE SAGITTAL IMAGE' 
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WAIT FOR 
MOUSE 
BUTTON TO 
BE CLICKED, 



296 
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PERFORM EDGE Ub I hCT ION — 
AROUND THE MOUSE COORDINATE. 
EDGE DETECTION IS PERFORMED 
USING J. CANNTS [1] GRADIENT 
BASED METHOD 



300 



IF AT 
LEAST 3 EDGE 
PIXELS FOUND, 

THEN 



302 
I 



ERROR: 
TRY AGAIN CLOSER 
TO THE FIDUCIAL" 



304 



MAP THE EDGE PIXELS TO 
THEIR CALIBRATED IMAGE 
COORDINATES [131. 
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TO FIGURE 7B 



FROM FIGURE 7B 
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FIG. 7B 



FROM FIG. 7A 
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TO FIG. 7A 
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FIND THE CENTER OF THE 
FIDUCIAL SHADOW USING THE 
CALIBRATED EDGE PIXELS [14] 
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DRAW A CIRCLE AROUND 
THE CENTER OF THE 
FIDUCIAL SHADOW 



312 



IF 

ALL EIGHT 
IDUCALS HAVE 
LOCATED 
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320 



322 



THEN 



SAVE THE ESTABLISHED 
IMAGE COORDINATES 
OF ALL FIDUCALS 



I 



ENABLE KEY: F6 
BRIGHTEN BUTTON: 
•REGISTER SAGITTAL IMAGE" 



I 



SEND MESSAGE: 
'REGISTER SAGITTAL 
IMAGE" 



GOTO: 
ENTRY2 IN FIGURE 9 






REGISTER A/P IMAGE BUTTON 
OR F5 KEY HAS BEEN PRESSED 




FIG. 8 
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IF ALL A/P 
FIDUCIALS HAVE 
.BEEN FOUND. 



ENTRY1: 



THEN 



332 



RECALL 2D COORDINATES 
OF THE A/P FIDUCIAL CENTERS. 



I 



334 



READ IN FROM FILE THE 
3D CMMED COORDINATES OF 
THE CENTER OF THE FIDUCIALS, 



336 




OPTIMIZE THE FIT BETWEEN THE 
3D CMMED COORDINTES AND THE 
2D IMAGE COORDINATES USING 

LEVENBERG-MARQUARDTS 
METHOD. [2] 



338 
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CONSTRUCT REGISTRATION 
MATRIX [3] 



340 



IF 

SAGITTAL 
IMAGE HAS BEEN 
REGISTERED 

THEN 



346 



SEND MESSAGE: 
"PICK ENTRY POINT 



348 (RETU^ 



ERROR: "HAVENT 
SELECTED ALL THE 
FIDUCIALS" 




328 



330 



SEND MESSAGE: "PERFORM 
SAGITTAL REGISTRATION" 



342 
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350 J REGISTER SAGITTAL IMAGE BUTTON 
OR F6 KEY HAS BEEN PRESSED 
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FIG. 9 
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if all SAGrrry 
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BEEN FOUND, 



ENTRY2: 



THEN 



358 



RECALL 2D COORDINATES 
OF THE SAGITTAL FIDUCIAL CENTERS. 



I 



360 



READ IN FROM FILE THE 
3D CMMED COORDINATES OF 
THE CENTER OF THE FIDUCIALS, 



362 



I 



OPTIMIZE THE FIT BETWEEN THE 
3D CMMED COORDINTES AND THE 

2D IMAGE COORDINATES USING 

LEVENBERG-MARQUARDTS 
METHOD. [2] 
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CONSTRUCT REGISTRATION 
MATRIX [4] 
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SEND MESSAGE: 
'PICK ENTRY POINT" 
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ERROR: "HAVENT 
SELECTED ALL THE 
FIDUCIALS" 
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SEND MESSAGE: "PERFORM 
A/P REGISTRATION" 
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TRANSVERSE ANGLE BUTTON 
OR F7 KEY HAS BEEN PRESSED 
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FIG. 10 



PLACE CURSOR IN 
THE ENTRY FIELD 



380 



ENTER THE NUMERIC VALUE 
FOR THE TRANSVERSE 

ANGLE 



I 



READ IN £ AND UPDATE THE 
ORIENTATION OF THE 
VIRTUAL GUIDEWIRE 
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REDRAW THE 
VIRTUAL GUIDEWIRE 
IN BOTH THE A/P IMAGE 
AND SAGITTAL 
IMAGE [7] 
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SCREW LENGTH BUTTON 
OR F8 KEY HAS BEEN PRESSED 
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FIG. 11 



PLACE CURSOR IN 
THE ENTRY FIELD 



ENTER THE NUMERIC VALUE 
FOR THE SCREW LENGTH 
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READ IN SCREW LENGTH AND 
UPDATE LENGTH OF THE 
VIRTUAL GUIDEWIRE [11]. 



I 



396 



REDRAW THE 
VIRTUAL GUIDEWIRE 
IN BOTH THE A/P IMAGE 
AND SAGITTAL 
IMAGE [7]. 
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404 
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SAGITTAL ANGLE BUTTON 
F10 KEY HAS BEEN PRESSED 
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I 



PLACE CURSOR IN 
THE ENTRY FIELD 



ENTER THE NUMERIC VALUE 
FOR THE SCREW LENGTH 



I 



READ IN cx AND UPDATE THE 
ORIENTATION OF THE 
VIRTUAL GUIDEWIRE [10]. 



I 



REDRAW THE 
VIRTUAL GUIDEWIRE 
IN BOTH THE A/P IMAGE 
AND SAGITTAL 
IMAGE [7] 
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FIG. 12 
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APPROACH ANGLE BUTTON ^\ 
O R F9 KEY HAS BEEN PRESSED ^ 



PLACE CURSOR IN 
THE ENTRY FIELD 



FIG. 13 
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ENTER THE NUMERIC VALUE 
FOR THE APPROACH ANGLE 
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READ IN y 
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MOVE ROBOT BUTTON OR 
F11 KEY HAS BEEN PRESSED 



I 




RECALL APPROACH 
ANGLE, y 



I 



RECALL a, 0, TX, TY, 72 

~~1 




CALCULATE THE PLANNED 
POSITION AND ORIENTATION 

D2L 

. I 



READ IN FROM FILE THE 
SURGICAL END-EFFECTOR 
DESCRIPTION AND ASSIGN IT; 
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FIG. 14 
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IF 

IND-EFFECTOR GETS 
ASSIGNED OK. 

THEN 



SEND ROBOT COMMAND TO 

MOVE TO THE PLANNED 
POSITION AND ORIENTATION 



I 



ASSIGN THE NULL 
END-EFFECTOR 




ERROR* 
"SURGICAL END-EFFECTOR 
NOT ASSIGNED" 
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ERROR' 
"NULL END-EFFECTOR 
NOT ASSIGNED" 



446 




1 * 



• 



24/28 




4 



CD 

LL. 




« I 

26/28 




